1. What is analysis? 



Objectives 

(1) Deeper understanding of basic properties of sequences: sandwich theo- 
rem, nested interval theorem. 

(2) Axiom of completeness is equivalent to the statement "every bounded 
non-increasing sequence converges" . 

(3) An overview of the problems arising in trying to do "calculus" . 

(4) Precise dcfiintioii of coiitiiiuity, and Iioav it accords Avitli irituiti\'c ideas. 



In lAll we studied sequences and series defined over the real numbers. The 
key technical idea was the following theorem: a bounded increasing sequence con- 
verges. This theorem is not true for the rational numbers and is the special feature 
of the reals that allows analysis to work. For the next part of analysis we need 
to have a difi'erent formulation of this theorem: an equivalent statement known as 
the Axiom of Completeness. 

Axiom of Completeness. The real numbers M are an ordered field (like Q) 
satisfying one additional axiom: 

if a set S is bounded above, then it has a least upper bound. (AOC) 

Notation. The least upper bound A of the set S is written l.u.b.(5') or s.u.p.(>S'). 
It is uniquely characterized by the following properties: 

(1) A is an upper bound for S, so s e S =^ s < A. 

(2) A is the least number with (1): ii s e S s < /x for some number /x, 
then fj, > X. 

An immediate consequence of this characterization is that the least upper bound 
of a set, if it exists, is unique (Prove this). 

Example 1.1. Let S = [0, 1]. Then l.u.b.(5') = 1. This was proved in the lectures. 

Example 1.2. Let S = (0,1). Then l.u.b.(5') = 1. This was proved in the 
lectures. The argument went as follows: firstly, x e S =^ a; < 1 so (1) holds. 
If (2) does not hold, then there is a number /x < 1 that is an upper bound for 5". 
But if /i < 1, then the number |(1 + /i) is in iS" (Check this) but is larger than fj, 
(Check this too), contradicting the assumption that /x is an upper bound for S. 
It follows that (2) holds. 

Before showing that AOC is equivalent to the convergence of non-dccrcasing 
bounded above sequences, we give a useful new form of that result, the Nested 
Intervals Theorem. 

Exercise. If an < a for all n & N and lim^^oo csn — cl, then a < a. Show by 
example that even if < a for all n, the < cannot be replaced by <. 
Repeat for > . 
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Exercise. Prove the Sandwich Theorem: if an < Xn < bn and lim„^.oo = a = 
lim^_^(X) bn then lim„_^ 

Theorem 1.3. Let [a^, ?>n] be a closed interval for each n e N. Assume that 
[ai, hi] D [a2, ^2] D [03, 63] D • • • D [on, &n] 13 • • • 

(^t/ie intervals are "nested"). 

(a) Then there is a number c e [a„, 6^] /or a/Z 77. e N. 

(b ) Moreover, if we also have 

lim {hn - On) = 

n— >-oo 

t/ien t/iere on/y one number c lying in all the intervals [amhri\. 

(c) Finally, if Xn £ [o-ni ^n] for all n and lim„_^(X) (6„ — a„) = then 

lim Xn = c. 

n— >oo 

Proof, (a) First, notice that the intervals being nested means exactly that the 

sequence (a^) is non-decreasing and the sequence (bn) is non-increasing. Since 
both sequences are contained in the set [ai, bi] they are bounded, so must converge. 
Let 

a= lim Gn', b= lim bn- 

Now an < a for all n and b < bn for all n. It follows (since the intervals are 
nested) that ap < bq for all p and q. Hence (use the exercise above) a < b. If 
c e [a, b] then c e [a^, &n] for every n. 

(b) If c e [ ^mbn] for every n then ^ c ^ hn for every 77.. Since lim„_j.oo 

(fen- 

a„) = 0, we have 

a — lim ttn = lim + lim {bn — an) 
= lim {an + (fen - ftn)) = lim fen = fe. 

n— >-oo n— >-oo 

It follows that a = b = c. 

(c) We have On < a^n < fen for all so by the sandwich theorem Xn converges to 
a = h = c. □ 

Theorem 1.4. The Axiom of Completeness is equivalent to the statement "every 
bounded increasing sequence converges". 

Proof. First assume the AOC and let {xn) be a bounded increasing sequence. 
Thus there is a number S with Xn < S for all n. Using AOC, we know that 
the set A = {xn} must have a least upper bound A = sup(A) say. We claim 
that limn_^(X) = ^- To see this, notice that for any e > 0, there must be 

an clement of the set A, say, with the property that ajv > A — e. (If not, 
A would not be the least upper bound). Then by the non-decreasing property, 
n > N =^ Un > ttN > X — e, so n > N =^ \an — A| < e. 
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Conversely, assume that every non-decreasing bounded above sequence con- 
verges and let A be a set that is bounded above by S say. Choose numbers ai and 
bi as follows: ai lies in A, and bi is any upper bound for A. Notice that 

[ai, 61] n A 7^ 0; X <bi for all x e A. 

Now chop the interval ai, bi] in half: consider the two intervals 

[ai, — - — J, and [ — ,bi\. 

If the second interval contains some points of A, then let a2 = ^^f^, 62 = If 
not, let a2 — ai and 62 = 2i±^_ By construction 62 is still an upper bound for A, 
so 

[a2, 62] n A 7^ 0; X <b2 for all x e A. 
Continue this bisection process to construct a sequence of nested intervals 

[01,61] D [02,62] D ••• 
with the property that lirrin^ooibn — dn) = 0. In addition, for every n e N, 

[an, 6n] n A 7^ 0; X <bn for all x e A. 

By the nested interval theorem, there is a unique real number A with the property 
that 

A = lim an = lim bn- 

Claim that A = sup(^). 

To sec this, let x E A. Then by construction, x < bn for all 77. so a; < A = 
lim^_j,oo bn- It follows that A is an upper bound for A. 

On the other hand, if /i is any upper bound for A, then since [an, 6n] H A 7^ 
for all n, it follows that an < H for all n so A = lim„^.oo On < A*; proving that A is 
indeed the least upper bound. □ 

A simple remark that will be useful later is the following. 

Lemma 1.5. If a < b are real numbers, then there is a rational number r and an 
irrational number s with a<r<b, a<s<b. 

Notice that by applying Lemma 1.1 repeatedly we may find between any two 
distinct real numbers infinitely many rationals and infinitely many irrationals. 

In this course we shall use ideas from lAll to study functions. We have 
already seen at the beginning of lAll a discussion about the function f{x) = x^— 2; 
this function has the property that /(O) < and /(2) > 0. Can we conclude that 
there is a number ^ with < ^ < 2 and /(^) = 0? In Section 4 we shall single out a 
class of functions for which this kind of argument works - the continuous functions. 
We know already that there is no such ^ in the rationals, so the notion of continuity 
must involve properties that distinguish the real numbers from the rationals: the 
Axiom of Completeness, or equivalently results on limits of sequences and series. 

After we have developed the basic machinery of limits of functions, continu- 
ous functions, and some more material on sequences and subsequences, we prove 
the Intermediate Value Theorem (which, for example, asserts the existence of ^). 

The second half of the course is devoted to a rigorous development of calculus: 
what does it mean to say a function is differentiable or integrablel What general 
properties hold for such functions? 
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Areas 



At school you will have encountered the statement that definite integrals give 
the area under a curve. We don't really have any definition of area, so let's see 
how far we can get from a reasonable starting point: 

(1 ) the area of a rectangle with width a and height b is a x b, 

(2) the area of the union of two non-overlapping rectangles is the sum of 
their areas, and 

(3) if A is a subset of B then the area of A is less than or equal to the area 



Using this, let us try to find the area under the curve y = x between x = 
and X = 1; call this set A. 

Fix a natural number n. Split the interval [0, 1] into n equal sub-intervals by 
the partition V — {0, . . . , ^ = 1}. Associated with the partition P is a 
staircase-shaped set U{V) (solid lines) which contains A, and another staircase- 
shaped set L{V) (dotted lines) which is contained in A. What is the area of 



First rectangle is - x -, 
Second rectangle is - x -, 
and so on until 
nth rectangle is - x -. 
Thus the total area of the set U{V) is: 



ofB. 



U(V)1 









A similar calculation shows that the total area of L{V) is: 




Applying (3) we conclude that 
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As n goes to infinity it is therefore reasonable to conclude that the area of 
A is |. However, there are several problems left open. Does the answer depend 
on the choice of the partition P? Does this method work for any function? On 
the first homework sheet you will be asked to attempt such a calculation for the 
function g defined by g{x) = if x is irrational, and g{x) = 1 if a; is rational. 

Tangents 

A tangent to a curve y = f{x) at the point (t, f{t) is a straight line that 
touches the curve at that point and has the same slope as the curve - whatever 
that means. 

Consider the curve y — x^: we shall find the tangent to the curve at the 
point {t, t'^) by a limiting process. 

Call the point {t,t^) P, and let Q be another point on the curve, say Q = 
{t + h, (t + h)^). 













p 








/ t t+h 



The slope of the line through P and Q is given by 

f{t+h)-m _ {t+hr-t' _ 

{t+h)-t h 

so as /i — > 0, i.e. as Q moves to P, we expect in the limit to find that the slope at 
(t, t'^) is exactly 2t. 

Again, questions remain. Docs this process work for any curve? That is, is 
there a unique tangent at every point? See homework sheet 1 for more details on 
the following example. Let g{x) = \x\, and try to use the above method to find 
the slope of the tangent at x = 0. You will find that is +1 when h > 

and —1 when /i < 0, so it does not converge to any fixed number as — )■ 0. 

If the above process does work, then we shall say that the function / is 
differentiable and the function f'{x) = slope of that tangent at {x,f{x)) is called 
the derivative of /. 
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FUNDEMANTAL THEOREM 

We shall see later that, under certain conditions, the process of finding areas 
under curves {integration) and the process of finding slopes of tangents (differen- 
tiation) are inverse processes. This was first pointed out by Newton, and various 
precise statements of this result are called the Fundamental Theorem of Calculus. 



Continuity 

The function g{x) = \x\ has no derivative at a; = 0, but it does have some 
good properties: there are no jumps or breaks in the graph of g for example. How 
may we express precisely this property (which is roughly expressed by saying that 
the graph of g may be drawn without lifting the pen from the paper)? We begin 
by formulating exactly the property that the graph of a function / has no jumps. 

The function / has a jump at x = a if the graph of / breaks at a; = a and 
jumps to a different level. Here is the graph of the function 

r x<2 

fix) = \ 

^ \l x>2. 



Notice that the function has a jump of height 1 at the point x = 2. 



O 



\ f r 

1 2 

The jump may be detected by noticing that there are values of x arbitrarily- 
close to, but not equal to, 2 for which \f{x) — /(2)| > 0.9 say. Of course there is 
nothing special about the height of the jump or the location of the jump, so we 
make the following definition: 

Definition. The function / has a jump at the point x = a if there is an e > such 
that for every S > 0, there exists an a; 7^ a with \x — a\ < 5 and \ f{x) — /(a)| > e. 

Writing this out in quantifiers: / has a jump at the point a; = a if 

3 e > such that ^5 > 3 x,\x — a\ < S for which |/(a;) — f{a)\ > e. 

Pushing this one stage further, the function / is said to be discontinuous if 
it has a jump somehere. So / is discontinuous if 

3 a, 3 e > such that V 5 > 3 a;, |a; — a| < S for which \ f{x) — f{a)\ > e. 

The negation of being discontinuous will be called continuity: 
Definition 1.2. The function / is continuous if 



Va, Ve>03(5>0 such that \x — a\ < S 



\f{x)-f{a)\<e. 
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In sheet 1 you will check that the function f{x) — \x\ does have this property 
despite being non-difFerentiable. The definition of continuity will appear again in 
several different forms, and we shall see that the continuous functions are exactly 
those that satisfy the Intermediate Value Theorem. 



Things you should have learned in this section 

(1) How to prove and use the sandwich and nested intervals theorems. 

(2) How to manipulate the suprcmum and infimum of a set. 

(3) The definition of continuity for a function at a point. 
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2. The Limit of a Function at a Point 



Objectives 

(1) To develop a precise language for talking abour functions: domain, 
image, bounded. 

(2) To define the limit of a function at a point using punctured neighbour- 
hoods. 

(3) To relate limits of functions to limits of sequences. 



Recall the following standard notation for functions: a function is a triple 
/ : X — )■ y. The set X is the domain of /, and Y the codomain. For a subset 
A G X, the image of A under f is the set f{A) C Y. For a set B <Z Y, the 
pre-image of B under f is the set f~^{B) — {x & X \ f{x) G B} C A. 

Exercise. If B is non-empty, there is no reason to suppose that f~^{B) is non- 
empty. Why not? 

If the function / is a bijection then it has an inverse function f~^:Y^X. 

In this course all the function we deal with will be real-valued functions of 
a real variable, which means the sets X and Y will be subsets of M. 

Functions may be added, multiplied, divided (carefully!) and multiplied by 
real numbers in the obvious way: 

{f + g){x) = f{x) + g{x), 

{f9){x) = fix) X g{x), 

{f/9){x) = f{x)/g{x) 

(so long as g{x) ^ 0), and 

(A/)(a;) = Ax/(x), 

where A e M. 

Exercise. Given functions / : X — > y, and g : Z ^ W , what is the domain of 
f + g'^ What about fg and f/g7 

Definition 2.1. A function / : D — )■ R is said to be 

(1) bounded above on S C D ii 3 R such that f{x) < R ior x G S, 

(2) bounded below on S C D if 3 R such that f{x)>R for x G S, and 

(3) bounded on S C D if 3 K such that \f{x)\<KfoixeK. 

Definition 2.2. A neighbourhood of a is an open interval of the form 

(a — S, a + S), 

where 5 > 0. A punctured nieghbourhood of a is a set of the form 

(a — S,a)U (a, a + S) 

for some d > 0. 



Notice that a point is always contained in any neighbourhood of itself, and 
is NEVER contained in any punctured neighbourhood of itself. 
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Example 2.3. Consider the function / : R — )■ M defined by 

fix) = ^ . 

Draw the graph of /; from the graph we expect the following to be true. 

(1) / is bounded on [2, 5], 

(2) / is bounded above on (— oo, 1), 

(3) / is bounded below on (1, oo), 

(4) / is not bounded on any neighbourhood of 1. 

Proof of (1): For x G [2, 5], it is clear that 3 < a; + 1 < 6 and 1 < a; — 1 < 4, so 

1^1 < f = 6. 

I X — 1 I — 1 

Proof of (2): For x<l, x — 1<0, sox + l>a; — 1 implies that < 1. It 
follows that / is bounded above by 1 on the set (— oo, 1). 

Proof of (3): For a; > 1, a; - 1 > 0, so a; + 1 > a; - 1 implies that ^ > 1. It 
follows that / is bounded below by 1 on the set (l,oo). 

Proof of (4): If (4) is not true, then for some neighbourhood of 1, / is bounded: 
that is, there is a 5 > and a number K > with the property that 

a; e (1-5,1 + 5) =^ \f{x)\ <K. 

We want to show that this assumption leads to a contradiction, by exhibiting an 
X with the following properties. First, 1 < x < 1 + 5, and second, |/(x)| > K. A. 
calculation shows that 1 < a; < implies that f{x) > 2K, so we can complete 

the argument by choosing x = min{l + 5, ^+^_^ }. 

Definition 2.4. Let D be a set containing some punctured neighbourhood of a 
point a, and let / : -D — )■ M be a function. Then the limit of f{x) as x tends to a 
is £ if, for any e > 0, there exists a 5 > such that 

0<|a;-a|<5 =^ |/(a;)-^|<e. 

This is normally written as 

f{x) — >■ £ as a; — > a, 

or 

lim f{x) = £. 

x—^a 

Notice that / need not be defined at the point x — a. Even if it is defined 
there, the value of /(a) need not be equal to lim^^a /(^)- 

Example 2.5. Let 

f{x) = \ ^ ""^^ 
"^^ ^ 1 a;= 1. 

Prove that lima;_j.i f{x) exists and is equal to h. 
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To prove this, we must first understand how to estimate the size of the 
expression 

X 1 
1+x ~ 2 ' 

ideally in terms of the quantity \x — 1|. Now 

X 1 2x — {1 + x) 1 — X 
1 + x ~ 2^ 2(1+0;) ~ 2(1 + 

If |a; — 1| < then 1 + x > |, so by the above calculation — || < ||a; — 1|. 

From that calculation, it is now easy to write down the required statement. 
Given any e > 0, choose 5 < min {|,3e}. ThenO < |a;-l| < 5 =^ |/(a;)-|| < e. 

Example 2.6. Let 

( X x>l, 
[0 X <1. 

Then the limit of g{x) as x approaches 1 does not exist. 

We will have an easy way to prove this soon, but for now let us argue directly 
from Definition 2.4. If the limit exists, then for some i. we have: 

V e > 35 > such that 0<|a;-l|<5 =^ \g{x) - £\ < e. 

Assume that the limit does exist, so that this statement is true. Choose e = |, 
and notice that 

\gix) -e\<i \giy) -i\< \ =^ \gix) - giy)\ < \. 

(Make sure you see why this is so). Now, under the assumption that the limit 
exists, and choosing the b corresponding to e = |, we have a 5 > with the 
property that 

^<\x-l\<b =^ \g{x)-e\ < \. 

Let a; = 1 + |, and = 1 — |. Putting all of the above together, we conclude that: 

\g{x)-g{y)\ < \, 

which is clearly impossible since g{x) = x> 1 and g{\j) = 0. 

Work through Example 2.6 carefully, and make sure you understand that it 
is just a complete rendition of a simple idea that we have already encountered 
with sequences. If g{x) is approaching a limit as x approaches 1, then for x and 
y very close to 1, g{x) and g{y) must both be very close to whatever the limit 
is, and therefore very close to each other. On the other hand, it is clear from 
the definition of the function g that there are arbitrarily close-together pairs x, y, 
close to 1, with the property that g{x) is not close to g{y). 

Theorem 2.7. If a function has a limit at a point, then that limit is unique. 
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Proof. (First ask yourself how would prove that a convergent sequence can have 
only one limit.) 

Let / be a function defined on some punctured neighbourhood of a point c, 
and assume that f{x) — )■ £ as x — )■ c. 

Now assume in addition that f{x)^£'asx^c: our aim is to deduce that 
i must be equal to £'. 

If £ 7^ then there is a positive number e with the property that 2e < \£—£'\- 
On the other hand, by assumption we may find Si > and ^2 > such that 

< \x - c\ < Si =^ |/(a;) - £\ < e, 

and 

< |a; - c| < ^2 =^ \f{x) - £'\ < e. 
Choose X so close to c that < \x — c\ < Si and < \x — c\ < S2, so 

\f{x)-£\ <eand \ f{x)-£'\ < e. 
By the triangle inequality, this implies that 

\£-£'\ < 2e, 

which contradicts our choice of e. 

The only possible conclusion is that £ — £'. □ 

Again, work through the details and make sure that you understand the ideas 
behind the proof. 

So far all the proofs about limit of functions seem to closely resemble analo- 
gous results for sequences. The next theorem shows how the notions are related: 
the idea is again simple, but the details are a little tricky. 

First, some notation. Let c 7^ — >■ c mean the sequence {xn)nef^ converges 
to c and for each n, c. 

Now consider the following properties of the function / defined on some 
punctured neighbourhood D of the point c: 
[1] lim,^,f{x) = £, 

[2] if c 7^ — )■ c in D, then /(x^) — > £. 

Notice that [2] is expressed entirely in terms of sequences (in particular, if 
(xn) is a sequence then so is {f{xn)))- 

Theorem 2.8. [1] is equivalent to [2]. 

Proof that [1] =^ [2]. As we know, [1] means for any e > 0, there exists a 5 > 
such that 

0<\x-c\<S =^ \f{x)-£\<e. 

Let (xn) be a sequence with c ^ Xn ^ c, and let e > be given. Then choose 
S > according to [1] , and let N be chosen to have the property that 

n> N =^ < \xn - c\ < S; 
then we have found N such that 

n>N =^ \f{xn)-£\<e, 
showing that f{xn) £. □ 



12 



Proof that [2] =^ [1]. To do this, we shall prove the contrapositive statement, 
"not[l]" implies "not [2]". 
Assume therefore that 

3 e > s.t. y S > Q 3 x,0 < \x - c\ < S such that \ f{x) - £\ > e. 

Choose in turn (5 = l,|,|,^,...to find a sequence xi,X2,xs, ■ ■ ■ with the property 
that ^ 

< \xn — c| < — and \f{xn) — i\ > e. 

The first part of this shows that c 7^ — >■ c, and the second shows that f{xn) is 
not converging to £, so [2] is not true. □ 

Using Theorem 2.8, most of the basic properties of limits of functions follow 
easily from the corresponding results for sequences. There are some exceptions 
though - Theorem 2.9 is most easily proved using Definition 2.4. 

Theorem 2.9. If a function has a limit at the point c, then the function is hounded 

on some punctured neighbourhood of c. 

Proof. Suppose that f{x) — )■ £ as x — )■ c. Use e = 1 in Definition 2.4, and choose 
5 so that < |,T - c| < 5 =^ \f{x) - i\ < 1. Then, for all x with < \x - c\ < 6, 
\f{x)\ = \{f{x) — £) + £ < 1 + \£\, showing that / is bounded in a punctured 
neighbourhood of c. □ 

Theorem 2.10. Assume that f{x) — )■ £ and g{x) m as x ^ c. Then 

(1) f{x) + g{x) —f£ + m as x ^ c, 

(2) f[x)g{x) — )■ £m as x ^ c, 

(3) for A e M, A/(a;) ^ A x £ as x ^ c, and 

(4) if m ^ Q then f{x)/g{x) — >■ £/m as x ^ c. 

(5) if fix) < g{x) then £ <m. 

Proof. These follow from the corresponding statements about sequences. As an 
exercise, write out proofs without using sequences - as with sequences, you will 
need Theorem 2.9. □ 

Example 2.11. Show that Yim.x^2 ^l^T^^^^^ exists and find the limit. 

We have shown that, for example, \im.x^2 x = 2. It follows by Theorem 2.10 
that \\mx^2 x^ = 8, lima;^2 x^ — 2x^ = 8 — 2 \imj;^2 x^ = and so on, showing 
that the limit exists and equals 

Example 2.12. In practice it is more important to be able to find limits like 

Unix ^2 ^ ~2^^Yx-i8^ ' °^ even worse lim2:_^2 ^ ~tan(J~-2)~^ ■ Make sure you under- 
stand why neither of these is trivial, and see if you can work out what the limits 
are (use your calculator if need be). 

Example 2.13. Prove the Sandwich Theorem: if h{x) < f{x) < g{x) and h{x) 
£, g{x) — >■ £ as X — )■ c, then f{x) £ also. 

Fill in the details: the key idea is that if \h{x) — £\ < e, and \g{x) — £\ < e, 
then \h{x) - g{x)\ < 2e and so \ f{x) - £\ < 3e. 
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Example 2.14. Define a function / : M ^ R by 




x = 0. 



Prove that Uma;_^o f{x) does not exist. 

To do this, use the sequential equivalent definition of the existence of a limit 
in Theorem 2.8. Let Xn = and = ^2n+i)7r ' Then 7^ a;^ — >■ and 
7^ — >■ 0, but f{xn) = — > while /(j/n) = 1 — > I5 showing that the limit does 
not exist. 



Things you should have learned in this section 

(1) The definition of domian, co-domain, image, boundedness for functions. 

(2) The exact definition of what it means for a function to have a limit at 
a point. 

(3) How to prove theorems about limits of functions using results about 
sequences. 
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3. Other Limits of Functions 



Objectives 

(1) To formulate various "improper" limits: one-sided, limits at infinity 
and so on. 



It is sometimes useful to have definition for slightly difi^erent limits. Here we 
consider one-sided limits and tending to infinity. 

Definition 3.1. If / is defined on the set (c, c+ r]) for some r/ > 0, then £ is the 
limit of f from the right, written f{x) — )■ £ as a; — )■ c"*" or lim2,^c+ f{x) = i if, for 
any e > there exists S > such that < x — c < S =^ \f{x) — i\ < e. 

Of course there is a "from the left" version as well, written lima._j.c- • 

Theorem 3.2. Let f be defined in a punctured neighbourhood of c. Then 

lim f{x) = £ 

x—^c 

if and only if lim^^c+ f{x) = hm^^c- f{x) = £■ 

This Theorem (whose proof is trivial) is sometimes useful in showing that a 
limit does not exist: use it for Example 2.6 as an exercise. 

Definition 3.3. Let f be defined on some neighbourhood of c. Then f{x) tends 
to infinity as x tends to c, or lima^^c f{,x) = oo if, for every K & M. there is a 
5 >0 such that < \x - c\ < 5 f{x) > K. 

Exercise 3.4. Prove that lim^^-^c 1/(^)1 = oo if and only if lim^^-^c = 0- 

Of course there are other combinations: to make sure you understand this 
material, write out the definition of the statement lim^_^c- f{x) = — oo. 

Example 3.5. Fill in the details of the following. Let f{x) be defined by 

2x 3x 



X 



1 x^ 



for X ^ 1,2. Then lim^^i+ f{x) = +oo, lim^;^!- f{x) = -oo, lim^^2+ f{x) = 
— oo, and lima;^2- fi.^) = +oo. 



Things you should have learned in this section 

(1) How to prove statements involving one-sided limits and limits involving 
infinity. 

(2) How to use these ideas to help sketch graphs of functions. 
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4. Continuity - Basic Results 



Objectives 

(1) To formulate an exact notion of continuity at a point for functions. 

(2) To develop an "algebra" for continuous functions. 



Recall Definition 1.2, which characterised those functions that have no jumps. 

Definition 4.1. Suppose that / : L> — )■ M is defined in some neighbourhood of 
the point c. Then / is continuous at c if, given any e > 0, there is a 5 > such 
that 

\x-c\<S =^ \f{x)-f{c)\ < e. 

Notice the key difference between this property and the statement "/(x) 
has a limit as x ^ c". For continuity, we include the point c, and deal with 
neighbourhoods rather than punctured neighbourhoods. 

A function is said to be continuous on a set if it is continuous at each point 
of the set, and simply continuous if it is continuous at each point of the domain. 

Theorem 4.2. Suppose that f : D M. is defined in some neighbourhood of the 
point c. Then f is continuous at c if and only if 

lim/(a;) = /(c). 



Remember that the statement means two things: firstly, that the limit of 
f{x) as X approaches c exists, secondly that it is equal to f{c). 

Proof of Theorem 4.2. A careful comparison of Definition 4.2 and Definition 2.4 
shows that continuity at the point c is exactly the same property as lima;^c f{x) = 
/(c). Check that you understand what happens to the special point c in this 
comparison. □ 

All the results of Section 2 may now be applied to deduce properties of 
continuous functions. For some, the proof is given; for the later ones you should 
provide the proof. 

Theorem 4.3. Suppose that f : D ^ M. is defined in some neighbourhood of the 
point c. Then f is continuous at c if and only if for every sequence Xn ^ c in D, 

lim f{xn) = /( lim Xn) = f{c). 



Proof. This follows at once from Theorem 2.7 - again, make sure you see what 
happens to the special point c. □ 

Notice that Theorem 4.3 is an example of a special situation in which a limit 
commutes. On the homework you will see some situations involving discontinuous 
functions where a limit does not commute with the function. 

15 
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Theorem 4.4. // / is continuous at the point c, then f is bounded on some 
neighbourhood of c. 

Proof. By Theorem 2.8, / is bounded on some punctured neighbourhood of c. It 
is also defined at c, so we are done. □ 

Theorem 4.5. Suppose that f and g are continuous at c. Then so are 

(1) f + 9, 

(2) A/ for A e M, 

(3) f X g, and 

(4) f/g ifg{c)^0. 

Proof. Apply Theorem 2.8 □ 

Examples 4.6. (1) Let / : M — )■ M be a continuous function with the property 
that /(r) = whenever r is rational. Prove that f{x) = for all x G ffi. 

This is best done using Theorem 4.3: fix a real number x, and let ri, r2, ^"3, . . . 
be a sequence of rational numbers converging to x. Then, by assumption /(r„) = 
for all n, so by continuity 

fix) = /( lim rn) = lim /(r„) = 0. 

n— >oo n^oo 



(2) Let : M — > R be a continuous function with the property that g{0) > 1. Prove 
that g{x) > 0.9 for all x in some neighbourhood of 0. 

For this problem, work directly from Definition 4.1. Take e = 0.1. Then by 
continuity, there is a 5 > for which 

|a; - 0| < 5 ^ \g{x) - g{0)\ = \g{x) - 1| < 0.1, 

so that g{x) > 0.9 for all x e {—5, 5). 

(3) Theorem 4.5 shows that, for example functions like f{x) = ^^^^^^^'^ are con- 
tinuous wherever they are defined. 

One last important "basic" result about continuous functions. 

Theorem 4.7. If g : A ^ B is continuous, and f : B ^ M. is continuous, then 
so is the composition fg-.A^M. defined by f ■ g{x) = f{g{x)). 

Proof. Let c be a point in A, and let — > c in A. Then by continuity of g, 
g{x„) g{c) in S, so by continuity of /, f{g{xn)) f{g{c)). □ 

Remark 4.8. If a function is defined on a set of the form [c, c + r?) say, then there 
is an obvious notion of the function being continuous from the right at c and so 
on. Write down the definition of this property, and the corresponding continuity 
from the left. We shall need this to make sense of statements like "/ is continuous 
on the set [a, 6]", which means 



V c e [a, 6], V e > 0, 3 5 > such that 



17 

X e {c- 5,c + 5)r\[a,h] =^ \f{x) - f{c) \ < e. 



Things you should have learned in this section 

(1) The definition of the statement "/ is continuous at a". 

(2) The definition of the statement "/ is continuous" . 

(3) How to prove theorems about continuous functions using known results 

oil sequences. 
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5. Continuity - Intermediate Value Theorem 



Objectives 

(1) To prove that bounded sequences have convergent subsequences. 

(2) To apply (1) to show that continuous functions on closed bounded 
intervals are bounded and attain their bounds. 

(3) To formulate and prove the Intermediate Value Theorem. 



We begin with the Bolzano-Weierstrass Theorem. 

Theorem 5.1. If (xn) is a sequence of points with Xn e [a,b] for every n, then 
there is a subsequence x^ , x^^ , x^^ > • • • that converges to some point c e [a, b] . 

The word subsequence means that the indices ni,n2, ■ ■ ■ are strictly increas- 
ing: 77-1 < 77-2 < 

We have seen already in lAll a result that guaranteed convergence: a non- 
decreasing sequence that is bounded above must converge. 

Proof of Theorem 5.1. Recall Theorem 2.10 from lAll: if (a„) is monotone 
non-decreasing or non-increasing and bounded, then it is convergent. 
It is therefore sufficient to show the following. 

Lemma. Any sequence (an) contains a subsequence (a^^.) which is either non- 
decreasing or non-increasing. 

Proof of Lemma. Let us say that n is a peak point of (xn) if < a„ for all 
m > n. There are two possibilities: 

Case 1 . The sequence has inGnitely many peak points. In this case, let ui < n2 < 
72-3 <.. . be the peak points, so that a„j > a^^ > o-ns > ■ ■ ■ is a non-increasing 
subsequence. 

Case 2. The sequence has only Gnitely many peak points. Let ui be chosen 
greater than any of the peak points. Since ui is not a peak point, there must 
be some n2 > ui for which ana — ^^ni- Since n2 is not a peak point, there is 
some 77,3 > ?i2 for which a^g > 0^2- Continuing, we arrive at the non-decreasing 
subsequence < < < • • • • D 



The Bolzano-Weierstrass Theorem is now clear: from the sequence (xn) ex- 
tract a non-decreasing or non-increasing subsequence. Since the original sequence 
lies in [a,b], the subsequence is bounded and hence convergent. 

The only thing left to check is that the limit of the convergent subsequence 
is also in [a, 6], but this is clear: if t ^ [a, b] then t is some positive distance from 
all elements of [a, 6], and hence from every term of the subsequence, and therefore 
cannot be the limit. □ 
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Theorem 5.2. Let f : [a,b] ^ M be a continuous function. Then f is bounded. 

Notice that two things are needed for the result: the function must be con- 
tinuous, and the domain must be restricted. For example, 



fix) 



n xe ^) for n e N, 

for a; = 0, 1, 



is a discontinuous function on [0, 1] that is not bounded. 

On the other hand, ^(a;) = ^ is a continuous function on (0, 1] that is not 
bounded. 

Proof of Theorem 5.2. The function / is bounded on [a, b] means 

3 M, e [a,b],\f{x)\ < M. 

Assume (for the purposes of a contradiction) that / is continuous on [a, b] but is 
not bounded: 

V M, 3xe [a,b],\f{x)\ > M. 

It follows that there is a sequence of points a^i, a;2, . . . in [a, b] with the property 
that 

f{Xn) > n 

for each n e N. By the Bolzano-Weierstrass Theorem, the sequence (xn) has a 
subsequence Xn^ , a;^^ , . . . that converges: 

— )■ c G [a, b] as j — )■ oo. 

By continuity, 

/(c) = /(.lim Xn^) = lim f{xnj), 

so that the sequence {f{xnj))jen converges. It follows (check this) that the se- 
quence (|/(^Cnj)|)iGN converges, and is therefore bounded. This is a contradiction 
since each \f{xnj)\ exceeds Uj. 

It follows that / must be bounded on [a, 6]. □ 

Theorem 5.2 says that a continuous function on a closed bounded interval is 
bounded. In fact more is true: a continuous function on a closed bounded interval 
attains its bounds. Without some assumptions, this can fail even for bounded 
functions: for example the function f{x) = x on the set (0, 1) is bounded and 
continuous, but does not attain its bounds. 

Theorem 5.3. Let f : [a,b] ^ M be a continuous function. Then there are points 
$,,r] E [a,b] such that 

/(O = sup{/(a;) I x e [a, 6]}, 

and 

f{r]) = inf{/(a;) | x G [a, 6]}. 
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Proof. We shall prove one of these - the other follows at once (Why?). Let 

M = sup{/(a;) \ x e [a, b]}. 

Notice that M exists because of Theorem 5.2. Now by the definition of a sup, 
there must be values of f{x) arbitrarily close to M: for each n e N we may find 
Xn e [a, b] such that 

M - 1 < f{Xn) < M. 

By the Bolzano- Weierstrass Theorem, we may choose a subsequence {xnj)jen that 
converges to ^ e [a, 6] say. Then by continuity of /, 

/(C) = /( lim Xn^) = lim fixn,) = M, 

by the Sandwich Theorem. □ 

Before proving the Intermediate- Value Theorem, notice the following conse- 
quences of Definition 4.2. 

(1) If / : [a, 6] — )■ M is continuous, and /(a) < A then for some 5 > 0, f{x) < A 
for all X in [a, a + d). 

(2) If / : [a, 6] — )■ M is continuous, and > A then for some S > 0, f{x) > A 
for all a; in (6 — 5, b] . 

Theorem 5.4. [Intermediate- Value Theorem] Suppose that f : [a,b] ^ R 
is continuous, and that f{a) < A < f{b). Then there is a point ^ e (a, b) for which 

m) = A. 

Proof. Define a set A as follows: 

A = {x\a<x<b, and / < A on the interval [a, x].} 

It is clear that A is non-empty since a G A. Also, b is an upper bound for A. 
It follows by the Axiom of Completeness that A has a least upper bound ^, with 
a < ^ < b. By the remark above (and the homework), we know that there is 
a. 5 > such that [a,a + S) C A and 6 — 5 is an upper bound for A, so in fact 
a < ^ < 6. This is used below - check that you understand where. 

To prove that /(^) = A, we eliminate the two other possibilities /(^) < A 
and /(C) > A. 

Suppose first that /(^) < A. Then if e = A — /(^), let 5 > be chosen as in 
Definition 4.1 so that 

|a;-e|<<^ ^ |/(a;)-/(e)|<e. 

Then x — ^ + ^5 has f{x) < /(^) + e = A, so ^ + |5 lies in A. This contradicts 
the fact that ^ is an upper bound of A. 

Suppose, on the other hand, that /(^) > A. Again,let e = /(^) — A and 
choose 5 > to have 

\x-^\<S ^ \f{x)-f{0\<e. 

Then x = ^ — ^6 has f{x) > /(^) + e = A, so ^ — |5 is an upper bound for A, 
contradicting the fact that ^ is the least upper bound of A. 

The only remaining possibility is that /(C) = A. □ 
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Examples 5.5. (1) Let f {x) = — 2. Use the IVT to show that there is a real 
number whose square is 2. 

(2) Prove that any cubic polynomial has a real zero. 

(3) Let / : [0, 1] — )■ [0, 1] be any continuous function. Then / has a fixed point, 
that is a point c with /(c) = c. 

This is proved by applying the IVT to the continuous function 

g{x) = f{x) - X. 

(4) Prove that the equation 

x'^ 2a;2 + 3 _ ^ 
x"^ — 1 x"^ — A 

has four real solutions. 



Things you should have learned in this section 

(1) How to prove the Bolzano- Weierstrass theorem. 

(2) How to apply it to prove results about continuous functions. 

(3) How to prove and use the IVT. 
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6. Differentiability 



Objectives 

(1) To make precise the property of differentiability at a point. 

(2) To use known methods on hmits to prove that simple functions are 
differentiable. 

(3) To establish an algebra of differentiable functions. 



We saw in Section 1 how to find the slope or gradient of the chord joining 
a pair of points [x, f{x)) and {x + h, f{x + h)) on the graph of a curve y = f{x): 
the slope is 

fix + h)- fix) _ fix + h)- fix) 
ix + h) — X h 

Definition 6.1. Let / be a function defined on some neighbourhood of c. Then 
/ is differentiable at c if the limit 

h-^O h 

exists. If the limit exists, it is called the derivative of f at c, and is denoted /'(c). 
Notice that the definition may also be written as 

x—^c X — C 

Of course the quantity h must be allowed to be negative or positive: if h is re- 
stricted to be positive we arrive at the definition of / being differentiable from the 
right. 

A function which is differentiable at every point of a set is said to be differ- 
entiable on the set, and a function that is differentiable at each point of its domain 
is simply called differentiable. 

Examples 6.2. (1) Prove that fix) = x^ is differentiable. 
Proof: Notice that 

fix + h) - fix) x^ + 2xh + h'^ -x'^ 

— i = Z = 2x + h, 

h h 

from which it is clear that fix) exists and is equal to 2x. 

(2) We don't really have a definition of the function sin(x), but this function is so 
important that we shall make a provisional definition. Define (for now) a function 
sin : M — 7> M to be the signed length of the opposite edge of a right triangle with 
hypotenuse length 1 and angle x in radians. 
The first step is to show that 

hm = 1. 

x-^O X 
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To see that this is plausible, notice that the perimeter of a regular n-gon inscribed 
in a circle of radius 1 is given by 2nsin(7r/n). As n — > oo, this perimeter should 
converge to 27r. It follows that 

2nsin(7r/n) 2tt, 
so if we let x = ir/n we have as a; — >■ 0, 

sin(x)^2^_ 

X 

We also define cos(a;) via the relation sin^(a;) + cos^(a;) = 1 (and appropriate 
sign choices). Both sin(a;) and cos(a;) are continuous functions (this can be shown 
from the geometric definition), and the usual double- and half- angle formulae 
may be proved geometrically. 

Now 

sin(a; + /i) - sin(a;) _ 2cos(a; + I)) sin(|) _ sm(|) 
h " h " + 

and as /i — )■ 0, cos(a; + ^) — ?> cos(a;) and ^'"^y^^-* 1. It follows that sin(a;) is 
everywhere differentiable and sin'(a;) = cos(a;). 

Theorem 6.3. If f is differentiable at c then f is continuous at c. 

Proof. The function / is defined in some neighbourhood of c, and for values of x 
in that neighbourhood, 

/(^) - f{c) 
X — c 

converges to /'(c) as a; ^ c. It follows that 

f{x) - f{c) = M^M . _ e) 
X — c 

converges to /'(c) x = 0, so / is continuous at c. □ 

Remarks 6.4. (1) This says that differentiability is a stronger property than 
continuity. In Section 1 we saw that the function x ^ \x\ is continuous everywhere 
but is not differentiable at x = 0. Weierstrass extended this example to exhibit a 
function that is continuous at every point but differentiable at no points. 
(2) Any function that is not continuous at a point cannot be differentiable there. 

Theorem 6.5. If f and g are differentiable at c then 

(1) (/ + Xgy{c) exists and equals f'{c) + Xg'{c), 

(2) ifgyic) exists and equals f{c)g'{c) + f'{c)g{c), and 

(3) if/gYic) exists if g{c) ^ and equals '^"^^'^{^[^^l^^''^"^ ■ 
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Proof. (1) and (3) are exercises. For (2), / and g are defined in some neighbour- 
hood of c so for smaU values of h, 

f{c + h)g{c + h)-f{c)g{c) , ^, g{c + h) ~ g{c) , , /(c + /^)-/(c) 
h = ^) h h 

f{c)g'{c) + nc)g{c) 

as /i — > since /'(c), g'{c) exist and / is continuous at a; = c. □ 

Higher-order derivatives f"{x) and so on are defined in the obvious way: 
f"{c), if it exists, is {f')\c). Notice that, for example, if / has a fourth derivative 
then /" and must exist - and all of them must be continuous. 



Things you should have learned in this section 

(1) The definition of differentiability. 

(2) How to prove from the definition that simple functions are differentiable. 
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7. Applications 



Objectives 

(1) To understand the relationship between maxima and minima and the 

derivative for different iable functions. 

(2) To prove RoUe's theorem and deduce the Mean-Value Theorem. 

(3) To prove the Cauchy Mean- Value Theorem and deduce FHopital's rule. 

(4) To understand that the MVT is a simple form of Taylor's theorem. 

(5) To see a form of Taylor's Theorem with remainder. Proof included in 
notes but non-examinable. 

(6) To see how Taylor's theorem may be used to analyse maxima and 
minima when higher-order derivatives vanish. 



Continuity (via the IVT) allowed us to say when graphs of functions cross 
each other. Differentiation will tell us when graphs of functions are rising or falling. 
A function / : D — > M is 

(1) increasing on S G D if f{x) < f{y) whenever x,y & S have x < y, and 

(2) strictly increasing on 5 C -D if f{x) < f{y) whenever x,y e S have x < y. 

(You can work out the meaning of decreasing and strictly decreasing yourself.) A 
function is called (strictly) monotone if it is either (strictly) increasing or (strictly) 
decreasing. 

Definition 7.1. Let / be defined in some neighbourhood of c. Then / has a local 
maximum (resp. minimum) at c if f{x) < f{c) (resp. f{x) > /(c)) for all x in 
some neighbourhood of c. 

Example 7.2. The function f{x) = x"^ + 4x + 1 is strictly decreasing on the 
interval {—oo, —2], strictly increasing on [—2, oo) and has a local minimum at 2. 

Theorem 7.3. Suppose f is differentiable at c and has a local maximum or min- 
imum at c. Then f'{c) = 0. 

Warning. As usual, beware of the converse: the function x i-^ x^ has zero deriv- 
ative at X = but has no local maxima or minima. 

Proof. Suppose / has a local maximum at c. Then for /i > and small, 

f(x + h)-fix) 
h 

while for /i < and small, 

f(x + h)-f{x) 
h 

We know / that is differentiable at c, so 



< 



> 0. 



f'ic) = hm ^^^ + ^^-^^^^ < 0, 
■' ^ ' h^Q+ h - ' 
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and 



■' ^ ' h^o- h 



which shows that f'{c) = 0. 



□ 



A point c at which /'(c) = is called a stationary point of /. The next 
Theorem says that a difFerentiable function that goes up and then down (or down 
and then up) must have a stationary point. 

Theorem 7.4. [Rolle's Theorem] // / : [a, 6] R is continuous, f is differ- 
entiable on {a, b), and f{a) = f{h), then for some c e (a, h), f'{c) = 0. 

Proof. By Theorem 5.3 and continuity on [a, b], there are points ^, r; such that 

/(0 = sup{/(x) \xe [a, 6]}, 

and 

/(ry) = inf{/(x) | x e [a,b]}. 

If either ^ or r] lies in (a, b) we are done by Theorem 7.3. If not, then / is constant 
and so any point c G (a, b) will do. □ 

More generally, a differentiable function whose average (or mean) slope over 
some interval is A must have a point whose derivative is A. 




Theorem 7.5. [Mean Value Theorem] // / is continuous on [a, b] and differ- 
entiable on (a, b), then there is a point c e (a, b) with 



fie) 



f{b)-fia) 
b — a 



Proof. Let g{x) = /(a;) — ^^^-^^^^^^ j (x—a). Check that satisfies the hypotheses 
of Rolle's Theorem. □ 
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Corollary 7.6. If f'{x) = on (a, 6) and f is continuous on [a, 6], then f is 
constant on [a, b] . 

Proof. For any a; G (a, 6], / is continuous on [a, x] and different iablc on (a, x), so 
by the MVT there is a c e (a, x) such that /'(c) = = so f{x) = /(a) 

for all X E {a,b]. □ 

Examples 7.7. (1) Deduce that if / and g have the same derivative on [a,b], 
then they differ by a constant. 

(2) The same idea we used in Corollary 7.6 gives other useful results. For example, 
if f'{x) > on (a, b) and / is continuous on [a, b], then / is increasing on [a, b] 

(3) In (2) - and on the homework - we have for example the result that a differ- 
entiable function whose derivative is positive is strictly increasing. The converse 
does not hold of course: x ^ x^ is strictly increasing everywhere but does have a 
stationary point. 

Theorem 7.8. [Cauchy Mean-Value Theorem] Suppose that f and g are 
continuous on [a, b] and differentiable on {a, b), with g'{x) ^ /or x e (a, 6). Then 
there is a point c G (a, b) for which 

f'jc) _ fjh) fja) 
g'{c) g{b)-g{a)- 



Proof. Notice that an argument is needed: if the MVT is applied to the two 
functions /, g, we will get two different points c, d with 

f'jc) _ fib) - fja) 
g'{d) g{b)-g{a)- 

First apply the MVT to g to see that g{b) — g{a) 7^ 0. Next, define 

<t>{x) = [g{b) - g{a)]f{x) - [f{b) - f{aMx), 

and notice that satisfies the hyptheses of the MVT. Hence there is a point 
c G (a, b) such that 

</.(6)-0(a) = (&-a)(/>'(c). 

Now (f){b) - 4){a) = 0, so 

[gib)-gia)]fic)-[fib)-fia)]g'ic) = 0, 
which gives the result since g{b) — g{a) 7^ 0. □ 

In Section 2 we were not able to compute expressions of the form lim^^^a "^r^ 
when lim^j^a /(x) = = liuij^^a g{x). The Cauchy Mean Value Theorem allows 
us to say more about this in a special case. 
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Theorem 7.9. [L'Hopital's Rule] Suppose that 

lim f{x) = and lim g{x) = 0, 

x—^a x—^a 

and also suppose that linix^a ^^{fy exists. Then limj;_j.„ exists, and 



X- 



>a g(^x) x^a g'{x) 



Proof. The hypothesis that \im.x^a ^ttIy exists imphes that 

(1) f'{x) and g'{x) exist on the punctured neighbourhood (a — 5, a) U (a, a + 5) 

for some 5 > 0; 

(2) in this punctured neighbourhood of a, (^'(a;) ^ 0. 

Now a priori f and need not be defined at o; define /(a) = 5f(a) = 
so that / and g become continuous at a. Now consider the interval [a, x] for 
some X e {a,a + 6). Applying the Mean Value Theorem to g, we see that g{x) ^ 
(Why?). Applying the Cauchy Mean Value Theorem to / and g, there is a number 
ax e {a, x) such that 

[f{x)-0]g'{ax) = [g{x)-0]f'{ax), 

so 

fix) _ f'M 
g{x) g'{ax) ' 

Now as X approaches a, ax approaches a; since lima;_5.a ^ ,\^\ exists it follows that 

Ito 44 = lim 4^4 = lim 44. 

x^a g[x) x^a g'{ax) V^a g'{y) 

□ 

Notice that the MVT is a special case of Taylor's Theorem: let a = 0, 6 = x, 
and then it says that if / is continuous on [0, x] and differentiable on (0, x), then 

/(x) = /(0) + x-/'(O 

for some ^ e (0, x). 

Theorem 7.10. [Taylor's Theorem] Suppose f, f, . . . , /(^) are continuous 
on [a, b], and /("•+^) exists on (a, b). Then, for each x e (a, b) there is a 6 E (a, x) 
such that 

n=0 

where 

(iV+1)! ^^""^ • 
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Proof. Define Rn{x) — /(a^) — X^^=o ^ n\ ^^ (x— a)"". Then Rn{x) is differentiable. 
Now consider the function 



N 



JV+1 



n=0 ^ 

Notice that ^{x) = $(a) = 0, $(|/) is continuous on [a, x], and ^' exists on (a, x). 
By RoUe's Theorem, there is a ^ e (a, x) such that ^'{9) = 0. On the other hand, 

n=0 n=l 

Substitute y = 9 to obtain 

0-^'(9)- il^l^U 9)^ + B (r) iN + l){x-9r 

so 

□ 

Examples 7.11. (1) Let f{x) = e*. Since f'{x) = e*, for < x there is a 
9 e (0, x) such that 

e" = l + a;+— - + — - + h 



2! 3! n! (7V+1)! 

For any fixed value of 6*, 

as iV — > oo so there is an expansion 

cover gent for all x^. 

(2) Let f{x) = log(l + x). Then f'{x) = /"(x) = (jf^ and so on. So for 
any a; > 0, there is a ^ G (0, x) with 

log(l + a;) = a;- — + - + ^ + ^ ^ 



2 3 N {l + 9)^+^N + 1' 

We can only be sure that the remainder term will converge to zero if |^| < 1, so 
we have the convergent series 



log(l + x) = x- — + ^ 



valid for \x\ < 1. 



^ Treat this example with some caution: it is perfectly correct, but the function a; i— >• is 
really defined to be this Taylor series. 
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Theorem 7.12. Let f be differentiable (n + l) times on [a — h,a + h], and assume 
that f'{a) = f"{a) = ■■■ = /("-^)(a) = and f^'^a) ^ 0. Then 

(1) / has a local minimum at a if f^'^\a) > and n is even. 

(2) / has a local maximum at a if f^^\a) < and n is even. 

(3) / has a point of inflection at a if n is odd. 

Proof. What determines the sign of the remainder term in Taylor's Theorem? □ 



Things you should have learned in this section 

(1) Statement and proof of RoUe's Theorem, Cauchy MVT, MVT. 

(2) How to use the MVT to relate the derivative to the behaviour of a 
function. 

(3) Exact statement of I'Hopital's rule and how to use it to find indetermi- 
nate limits. 

(4) Exact statement of Taylor's Theorem with remainder and how to use 
it to show that standard Taylor series converge. 

(5) How to use Taylor's theorem to prove results about maxima and min- 
ima. 
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8. The Riemann Integral 



Objectives 

(1) To define rigorously tlie definite integral. 

(2) To find methods for proving that functions are integrable. 

(3) To see examples of integration from first principles. 



In this section we will give a rigorous definition of the meaning of expressions 

like 




f{x)dx. 



The basic idea has already been described in Section 1: the definite integral above 
represents the area under the graph of / from x = a to x — b, which may be 
approximated by rectangular strips. The technical questions to be dealt with are 
the following. First, when this process works, does it matter how the strips are 
chosen? Second, for which functions does this process of approximation converge? 

Throughout this section, we shall be dealing with a bounded function / : 
[a, b] R. 

Definition 8.1. A partition, V, of the interval [a, 5], is a finite set of points 
{xo, xi,. . ., Xk} satisfying 

a — xq < xi < ■ ■ ■ < Xk-i < Xk = b. 

Definition 8.2. If V and Q are partitions of [a, b] and P D Q, then is a 
reGnement of Q. 

Corresponding to a partition V are the upper and lower sums for f over V, 

k 

= J]M,(xi-Xi_i), 

i=l 

k 

i=l 

where Mj = sup{/(a;) | x e [a;i_i,a;i]} and rrii — inf{/(a;) | x G 

Notice that Mi and rrii exist since / is bounded. If M = sup{/(a;) | a; G [a, 5]} 
and m = inf{/(a;) | a; G [a, &]} then 

m{b -a)< L{r) < U{V) < M{b - a). 

Let $ denote the set of all partitions of [a, 6]. Then, by the above, 

{U{V) I P G $} 

is non-empty and bounded, so 

U = inf{[/(P) I P G $} 

exists. Similarly, 

L = sup{L(P) I P G $} 

exists. 
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Definition 8.3. \i L = U then / is Riemann integrable over [a, b], and the com- 
mon value of U and L is the Riemann integral of f over [a, b] , denoted f or 
f{x)dx. 

Lemma 8.4. If Q is a refinement ofV, then 

L{V) < L{Q) < U{Q) < U{V). 

Given two partitions V and Q, their union TZ = VyjQis called the common 
refinement of V and Q. 

Lemma 8.5. IfV and Q are any partitions of[a,b] then 

L{V) < U{Q) 

and so 

L{V) <L<U< U{Q). 

Proof. Let TZ = V Q denote the common refinement of V and Q. Then by 
Lemma 8.4, 

U{n) < U{Q) and L{V) < L(7^). 

However, L(7^) < ^7(7^) and so L(P) <U{Q). 

Since L{V) < U{Q) for all P, Q e $, we obtain for fixed V that 

L(V) < inf{?7(Q) \Qe^<U, 

and so L{V) <L<U < U{Q). □ 

Example 8.6. Define /(x) = c for x G [a, 6]. Prove that f = c{b — a). 

Let V = {xq, xi, . . . , Xk} be any partition of [a, b]. It is clear that L{V) — U {V) — 

c{b — a), and since V was arbitrary, this shows that f^f = c{b — a). 

Several of the main theorems on integration will not be proved in this course 
- but for most of them you should be able to come up with a proof. 

Theorem 8.7. [Darboux's Criterion] Let f : [a,b] R be bounded. Then 
f is Riemann integrable if and only if, for every e > there is a partition V for 
which U{V) - L{V) < e. 

Proof. Suppose first that for every e > there is a partition V with 

U{V) - L{V) < e. 

Since 



inf{C/(Q) I Q G $} < U{V) 
sup{L(Q) I Q e $} > L{V) 
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it follows that 

inf{C/(Q) I Q e - sup{L(Q) | Q e < e. 

Since this holds for all e > 0, it follows that 

M{U{Q) I Q e = sup{L(Q) I Q e $}; 

so by definition / is Riemann integrable on [a,b]. 
Conversely, if / is integrable then 

inf{C/(Q) I Q e $} = sup{L(Q) | Q G 

This means that for each e > there are partitions Q, TZ such that 

U{Q) - Lin) < e. 

Let V = Quiz he the common refinement of Q and TZ. Then by Lemma 8.4, 

UiV) < U{Q) 
L{V) > L{n), 

so 

U{V) - L{V) < U{Q) - L{n) < t. 



□ 



The next Theorem requires a notion {uniform continuity) beyond this course 
and is therefore left without proof. 

Theorem 8.8. If f : [a,b] ^ M. is continuous or monotone then it is Riemann 
integrable. 

To end this section, we shall do the example from Section 1 again, but this 
time justifying everything. 

Example 8.9. Let f{x) = x. From the definition, find the Riemann integral f. 
First, by Theorem 8.8 the integral exists - all we need to do is find the value. Let 
P„ = .[0, ^, |, . . . , 1}. By the calculation in Section 1, 

^(^») = 5 + ^ »d ^<^") = 1-1- 

Now apply Lemma 8.5 to deduce that 

i-S^ = ^(^")^^^^^^(^») = i + S^' 

and so 

11 1 1 

</ /<-H . 

2 2n - io 2 2n 
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Letting n tend to infinity gives the result by the Sandwich Theorem. 

Notice in this example how Lemma 8.5 is used to let us pass from convenient 
special partitions to statements that apply to all partitions. 



Things you should have learned in this section 

(1) The definition of the Riemann integral. 

(2) Darboux's criterion and how to use it. 

(3) How to compute simple definite integrals from first principles. 
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9. General Theorems on Integration 



Objectives 

(1) To determine basic general properties of the definite integral. 

(2) To relate properties of continuous functions to properties of their inte- 
grals. 



Let / and g be bounded functions on [a, b] . 
Theorem 9.1. // / and g are Riemann integrable on [a,b], then 

(1) for c G M, cf{x) is also Riemann integrable and j^cf = c f- 

(2) f + g is Riemann integrable and /^(/ + g) — / + la 9' 

(3) f X g is Riemann integrable. 

(4) if f>^ on[a,b], thenj^f>0. 

(5) 1/1 is Riemann integrable, and |/^/| < 1/1- 

Proof. (2), (4) and (5) are easy - prove them as an exercise. You can look up 
(3) in one of the references. 

Here we shall prove the confusing case in (1): if c > then (1) is easy, so 
assume that c < 0. Let V = {a;o, . . . , Xk} be a partition of [a, b]. Then 

Mi{cf) = sup{c/(x) I X e [xi-i,Xi]} = cinf{/(a;) | x e [xi-i,Xi]} 

so that U{V) = cL{V). It follows that U{cf) = cL{f). A similar argument gives 
L{cf) — cU{f), which gives the result. □ 

Remark 9.2. So far we have defined f for a < 6. If we define f = — J^, 
and / to be if / is defined at a then 

ff^ff^ff 

J a Jb J a 

whenever either side of the equality is defined. 

Example 9.3. Let / be a continuous function on [a, b] with the property that 
f{x) > for all X e [a, b] and /(c) > for some c e [a, b]. Prove that /^^ / > 0. 
Solution. The point here is to show the integral is positive - it is clear that the 
integral is non-negative. Assume for now that c e (a, 6) (the case c = a or c = 6 is 
similar), and let e = /(c)/2 > 0. By continuity, there is a 5 > with the property 
that 

|a; — c| < S X e [a, b] and |/(a;) — /(c) | < e, 

which implies that f{x) > f{c) — e > /(c)/2. (Draw a picture). 
It follows that 

r f>^x m > 0. 

Jc-S ^ 

35 



36 

On the other hand 
and 

so we are done. 



Things you should have learned in this section 

(1) General properties of integration (linearity, positivity and so on). 

(2) Estimates for integrals. 
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10. The Fundamental Theorem (s) of Calculus 



Objectives 

(1) To prove both forms of the fundamental theorem of calculus. 

(2) To apply the fundamental theorem. 



Theorem 10.1. Let / : [a, 6] ^ M he Riemann integrable, and define a function 
: [a, 6] ^ M by 



<f>{x) = [ f. 

J a 



Then (f) is continuous. 



Proof. Let x be a point in [a, b] and let h ^ be chosen with the property that 
x + he [a,b]. Then 



<Pix + h)-(P{x)^ [ ^ f 

J X 



(Notice that ii x = h, then h is automatically negative). 

Now / is bounded on [a, 6], so there is a such that \f{t)\ < K for all 
t G [a, b] . It follows that 

J X 

as /i ^ 0. □ 

Theorem 10.2. [first fundamental theorem of calculus] /// : [a, 6] M 
is integrable over [a, h] and continuous at the point c e [a, h] then (f){x) = f is 
differentiable at c. Moreover, (f)'{c) — f{c). 

Notice that c might be a or fe, in which case the theorem is true with the 
obvious left- or right- sided notion of differentiability. 

Proof. Let h ^ he chosen with c + h e [a,b]. Then 
(j){c + h)- (f){c) 



h 



1 pc+h 

= hj, [/w - m]dt. (1) 

Let e > be given. Since / is continuous at a; = c, there is a 5 > for which 

te{c-S,c + S)n[a,b] ^ \f{t)-f{c)\<e. (2) 
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It follows that for < 5, by (1) 

(j){c+h) - 0(c) 



h 



f{c) 





1 




W\ 




1 


< 






W\ 




1 


< 





- f{c)]dt 



c+h 



\m-m\dt 



c+h 



edt 



so 4>'{c) exists and equals /(c). 



□ 



Theorem 10.3. [SECOND fundamental theorem of calculus] Suppose that 
/ : [a, 6] — )■ M is continuous on [a, b]. Then there exists a function F : [a,b] ^ M. 
such that F\x) exists and equals f{x) on [a,b], and 



f 

J a 



f = F{b)-F{a). 



(1) 



Moreover, if F is any function such that F'{x) = f{x) on [a,b] then (1) holds. 

Proof. Since / is continuous on [a, 6], it is Riemann integrable over [a, 6]. Define 
as usual (j){x) = / for x G [a, b]. 

Since / is continuous, 4)'{x) exists and equals f{x) by Theorem 10.2. Also, 
by definition of 0, 

rb 

/ = 0(6) = 0(6) -0(a). 

That is, for the first part of the Theorem we may choose F to be 0. 

Now let F be any function with the property that F'(x) = f{x) on [a, 6]. 
Since F is differentiable, it is certainly continuous on [a, 6], as is 0. So G{x) — 
F[x) — 4>{x) is continuous on [a, 6], and G'{x) = F\x) — (f)'{x) — 0, so G{x) — C 
for some constant C. Then F{x) = (j){x) + C, and so F{a) = C since 0(a) = 0. 
Hence f = (f){b) = F{b) -C = F{b) - F{a). □ 



Things you should have learned in this section 

(1) Statement and proof of both versions of the fundamental theorem of 
calculus. 
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11. "Elementary" Calculus 



Objectives 

(1) To rcA'icnv some eleiiiciitary syiiiliolic integration. 



Now that the basic theory is set up, wc can indicate some extensions of 
integration, and some techniques for computing integrals and derivatives (it is 
sometimes useful to be able to do this). 

Improper Integrals 
An integral is said to be improper if it involves infinity, either explicitly: 

f°° 1 
J„ = — dx 
Ji xP 

or implicitly: 



^0 



1 

In either case, the approach is the same: the "infinity" is apporached as a 



1-0=1 — dx. 

^ ' XP 



limit. 

Example 11.1. The improper integral f exists if the limit 



R 



lim / / 

R^oo 

exists, and in this case is defined to be this limit. 

Example 11.2. Similarly, if / is undefined at say but is defined elsewhere, then 
Jq f is defined to be 

lim / / 

if this limit exists. 



We have seen this already in lAll, where improper integrals were used in 
the Integral Test for convergence of series. 

Logarithms 
For a; > 0, define a function by 

log(a;) = ln(a;) = jdt. 

By the Fundamental Theorem, log' (a;) = K Choose a number y > and let 

f{x) = log{xy). 
39 
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Then f'{x) — \og'{xy) - y — ^ - y — ^- Thus /' = log'. This means that there is a 
constant c such that 

f{x) = log{x) + c for all a; > 0. 
When a; = 1 we see that c = log(y), so 

\og{xy) = log(a;) + \og{y) for all x,y > ^. 
It follows easily that for n G N and x,y > 0, 

log(a;"^) = nlog(a;) 

and 

log (^^^ = log(a;) - log(y). 

Since log(2") = nlog(2) and log(2~"^) — — nlog(2), log is unbounded below 
on (0, 1) and is unbounded above on [1, oo). It is also strictly increasing, so log is 
a bijection from (0, oo) to M. 

Definition. The inverse of log is the exponential function, exp : R — > (0, oo). 
Notice that 

In/. ^ 1 



exp'(a;) = (log )'(a;) 



log' (log ^{x)) 



= log~"''(x) = exp (a;). 

Other properties follow from the properties of log; for example, exp{x + y) — 
exp (x) exp (y). 

Integration Techniques 

It is sometimes important to be able to evaluate integrals in elementary 
terms. The first step is to notice that the fundamental theorem shows that every 
derivative we compute yields an integral: if we observe that 

F[x) = X arctan(a;) — 

has 

F'ix) = arctan(a;), 

then we may deduce that 

1 ^^ I ^2^^ 

" la" 



arctan(a;)aa; = a;arctan(a;) — ' 



For brevity, we will deal with ■pTimitives or indeGnite integrals, that is any 
function whose derivative is equal to the integrand. 
[1] Integration By Parts. If /' and g' are continuous, then 



J fg' ^ fg - J f'g- 
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Example 11.3. (1) Let g'{x) — ^ and f{x) = logx. Then 

(1/x) logxdx — logx ■ logx — (l/x) logxdx. 



J llogxdx=^^^. 

(2) A simple calculation by parts gives J logxdx = x{logx) — x. Let f{x) = logx 
and g'{x) = logx. Then g{x) = a; log a; — a; so 

/(logx)(logx)<ix = (log.) [.(log.) - x] - /(l/.)[x(logx) - .]d. 
= (log.)[.(log.)-.l-/[log.-l]d. 

= (log.)Wlog.)-xl-/logxdx + /ldx 

= (log a;) [a; (logx) — x] — [a; (log a;) — a;] + a; 
= a;(loga;)^ — 2a;(loga;) + 2a;. 



[2] Substitution Formula. If / and g' are continuous, then 

'9{a) 



/ /= / ifog)-g'. 

J q(a) J a 



Example 11.4. (1) Find / ^dx. 
Let tt = e*; the integral becomes 



1+u 1 [2 1 

—du = / 1 — att, 



1 — u u .1 1 — u u 



so 

^ ^ ^%a; = -2 log(l - e^) + x. 



I 



1 - e« 



(2) Prove that JVl — x'^dx = | arcsinx + ^xs/l — 

(3) A substitution that will transform any rational function involving trigonometric 
functions into a rational function (see below) ist = tan(a;/2). A simple calculation 
(that you should carry out) gives sin a; = j^l?, cos a; = For practice, use this 
substitution to derive a formula "discovered" by Wright in 1599: 



J secxdx = log (tan + ^)) • 
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Rational Functions 



A rational function is a quotient of polynomials ||fy- Notice that over the 
reals, every odd degree polynomial has a zero (Prove this), so that if 



then 



where m = ri + ■ ■ ■ + rk + 2(si + ■ ■ ■ + Si). Notice also that if the degree of p is 



> m, then ^ 



a polynomial + ^ where the degree of r is strictly less than m. 



So we assume that q has the decompoosition given above, and that p{x) ~ 
+ . . . has degree n < m. 

Theorem. The rational function has a decomposition into partial fractions 



p{x) 
q{x) 



ail 



+ 
+ 
+ 



{x — ai) 



+ 
+ 



{x - at) 

bi,ix + ci,i 
(x^ + Pix + 'yi) 

bi,ix + 
(a;2 + Pix + 7^) 



q{x) 

+ 
+ 



ai, 



[x — aiY^ 
{x - akY'' 



+ ... 



+ 
+ ■ 



■ + 
+ 



(a;2 + ^^a; + 7^)*^_ 



+ 



This impressive-looking theorem is trivial: cross-multiply by q and notice 
that you can solve the resulting system of linear equations for the a, b, c's on the 
right hand side. 

The main point is of coiirse that each of the expressions on the right hand 
side can be integrated in elementary terms. Make sure you sec how to do this: 
how, for example, would you compute J ? What about J ^^ipY ? 

Example 11.5. (1) Prove that 
/ , ^ o dx = -I \og{x - 1) + 7 log(a;2 + x + 1) + Vsarctan ( ^(2a; + ly/s) . 

J 1 — X'^ 6 D 6 \6 J 

(2) Prove that 



/ 



X + 4 1 

—5 -dx — - log(x + 1) + 4 arctan(a;). 

a;^ + 1 2 



(3) Prove that 

8 
71 



x^ + 1 



dx = log 



X 



2 + V2 + 1 



a;^ - V2 + 1 
+ 2 arctan + 2 arctan (x/2 - 1) . 



(4) For those who have encountered the hyperbolic functions: 



1 



a;4- 1 



1 , 1 

— arctanh x — - arctan a;. 

2 2 
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Example 11.6. The Gamma Function. An important classical function is the 
gamma function T{x). Prove that 

poo 

T{x)= / e-H'^-^dx 
Jo 

defines a function of x for all a; > (that is, show that the improper Riemann 
integral exists). Using integration by parts, show that 

T{x + 1) = xT{x), and r(l) = 1. 

Deduce by induction that r(n) = (n — 1)! for all n e N. 



Things you should have learned in this section 

(1) Various integration methods. 

(2) Statement and proof of the method of integration by parts. 

(3) Statement and proof of the method of partial fractions. 
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